A Fixpoint Logic for Labeled Markov Processes
نویسندگان
چکیده
We develop in this abstract a probabilistic fixpoint logic for Labeled Markov Processes (LMPs). One reason for doing this comes from [2, 3]. There, it was shown that the LMP logic characterizing bisimulation can be used to define in a natural way finite-state approximants of LMPs. An extension of this logic with fixpoints such as the one we propose allows for stronger notions of approximants. Steady properties, i.e. properties related to infinite behaviours, can be obtained in finite approximations. Our logic only deals with greatest fixpoints. In a probabilistic setting, one has a the pending constraint that all logical terms denote measurable sets. Since measurability is preserved by countable boolean operations, only continuous or cocontinuous operators are meaningful. Least fixpoints are trivial in our case (more about this below) so we’re left with greatest fixpoints. As an illustration of the descriptive power of the logic, we provide an explicit construction of the coarsest probabilistic simulation of a given finite LMP by an arbitrary one. This construction is interesting in its own right. Finally a continuous state space example is given. An LMP can be described as a family of probabilities (p(s))s∈S indexed by the state space S, p(s)(A) representing the probability that the process will jump from s to A a measurable subset of S. In some special circumstances (when all the p(s) are mutually absolutely continuous, i.e. define the same negligible events) the Radon-Nikodým theorem makes it possible to extend the σ-algebra of events into a complete boolean algebra and therefore a logic with both fixpoints and arbitrary monotone operators seems possible. We might pursue this option in the future.
منابع مشابه
A Temporal Logic for Stochastic Multi-Agent Systems
Typical analysis of Markovian models of processes refers only to the expected utility that can be obtained by the process. On the other hand, modal logic offers a systematic method of characterizing processes by combining various modal operators. A multivalued temporal logic for Markov chains and Markov decision processes has been recently proposed in [1]. Here, we discuss how it can be extende...
متن کاملApproximating Labeled Markov Processes
We study approximate reasoning about continuous-state labeled Markov processes. We show how to approximate a labeled Markov process by a family of finite-state labeled Markov chains. We show that the collection of labeled Markov processes carries a Polish space structure with a countable basis given by finite state Markov chains with rational probabilities. The primary technical tools that we d...
متن کاملA Fixpoint Semantics and an SLD-Resolution Calculus for Modal Logic Programs
We propose a modal logic programming language called MProlog, which is as expressive as the general modal Horn fragment. We give a fixpoint semantics and an SLD-resolution calculus for MProlog in all of the basic serial modal logics KD , T , KDB , B , KD4, S4, KD5, KD45, and S5. For an MProlog program P and for L being one of the mentioned logics, we define an operator TL,P , which has the leas...
متن کاملNon Deterministic Logic Programs
Non deterministic applications arise in many domains, including, stochastic optimization, multi-objectives optimization, stochastic planning, contingent stochastic planning, reinforcement learning, reinforcement learning in partially observable Markov decision processes, and conditional planning. We present a logic programming framework called non deterministic logic programs, along with a decl...
متن کاملBisimulations for Nondeterministic Labeled Markov Processes
We extend the theory of labeled Markov processes with internal nondeterminism, a fundamental concept for the further development of a process theory with abstraction on nondeterministic continuous probabilistic systems. We define nondeterministic labeled Markov processes (NLMP) and provide three definition of bisimulations: a bisimulation following a traditional characterization, a state based ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003